Running

  • Welcome and opening remarks 09:00 AM - 09:10 AM Barry Quinn Co-Director of Finance and AI Research lab (Senior Lecturer of Finance, Technology and Data Science)

  • Keynote: AI in Citi 09:10 AM - 09:30 AM Carla McGlynn Managing Director (Head of Markets Data, Risks and Controls Technology/Tech Site Lead) Citi Belfast

  • Panel Discussion : Emerging Risks and Challenges in the Financial System 09:30 AM - 10:00 AM Fearghal Kearney Co-Director of Finance and AI Research lab (Reader of Finance) Kathryn Harkin Head of AI, FinTrU Carla McGlynn Paul Miller Director of the BRCD Momentum1.0

  • Leverage AI to understand regulatory compliance in investment management (Ukfin+ feasiblity) study) 10:00 AM - 10:20 AM Barry Quinn

  • Cyber risk, ChatGPT and Firm Value 10:25 AM - 10:50 AM Fearghal Kearney

  • Closing Remarks 10:50 AM - 11:00 AM

  • Network and Sandwiches 11:00 AM - 11:30 AM

Keynote: AI at Citi

Carla McGlynn

Global Head of Markets Business Controls & Belfast Site Lead, Citi

Project Summary

Evaluating the Feasibility of AI for Regulatory Compliance in Investment Management

  • This project, led by Dr. Barry Quinn and Dr. Jesús Martínez del Rincón from Queen’s University Belfast, aims to create an AI framework to simplify and enhance regulatory compliance in global investment management.

  • First major project for Finance and AI Research lab established in 2023.

  • The research focuses on Retrieval-Augmented Generation (RAG) and ontology learning algorithms to transform complex regulatory texts into clear, consistent rules reflecting current international standards.

  • Study Period 1/11/2024 - 31/10/2024

Key Objectives

  • Explore the advantages of AI in regulatory compliance for the investment management sector.
  • Evaluate AI’s impact on accuracy, efficiency, and cost-effectiveness.
  • Focus on key areas like regulatory reporting, risk assessments, and compliance monitoring.
  • Address challenges in using Large Language Models (LLMs), including hallucinations, reasoning, and auditability.

  • Funding: UKRI through the UKFin+ program for a 12-month period; FEC £99,871 (Nov 2024 - Oct 2025).

  • Industrial Partner: Funds Axis Ltd provides support and industry insights.

Finance and AI Research lab

Work Package 1: Use Case Definition, Data Collection & Process Mapping

Regulatory Focus

  • Codification of Investment Regulations:
    • Focus on EFAMA European Fund Classification Categories.
    • Rules for portfolio composition (e.g., asset class restrictions on equities, bonds, and country/industry limits).
    • Compare regulatory limits with existing portfolios to ensure compliance.
  • Document Analysis:
    • Use RAG to analyse multiple versions of regulatory texts for overlaps, inconsistencies, and conflicting rules.

Proposed Use Cases

  1. Portfolio Compliance:
    • Leverage Funds Axis’s classified spreadsheet for model training.
    • Train models to validate portfolio adherence to regulations.
    • Identify conflicting rules across versions.
  2. Advanced Legal Analysis:

Finance and AI Research lab (FAIR)

Client Engagement Opportunities

  • QA System Development:
    • Address client portfolio queries using grounded references.
    • Enhance credibility of responses through regulatory cross-referencing.

Next Steps

  1. Define First Use Case:
    • Review regulatory documents shared by Funds Axis.
    • Develop the portfolio compliance framework for initial testing.
  2. Plan In-Person Meeting:
    • Visit Funds Axis to review workflows and processes.
    • Map detailed use cases for inclusion in Work Package 1.

Finance and AI Research lab (FAIR)

Timeline

Timeline of Project

Finance and AI Research lab (FAIR)

Work Packages

Use Cases & Data Collection (Months 1-2)

  • Define precise regulatory and compliance scenarios.
  • Simulate investment firms using historical regulatory texts.
  • Compile datasets for training and evaluation.

Q/A Extraction (Months 2-3)

  • Develop a multi-hop question-answering system.
  • Fine-tune models like T5, Llama3.1, FinBERT.
  • Test for truthfulness and reasoning accuracy.

Rule Extraction with Ontology (Months 4-7)

  • Automate rule extraction using OWL ontology.
  • Integrate extracted rules into a dynamic knowledge base.
  • Ensure adaptability to evolving regulations.

Identifying Rule Set Inconsistencies (Months 8-10)

  • Use the MIMUS tool (McAveary et al. 2012) to detect inconsistencies in rule sets.
  • Resolve conflicts using Minimal Unsatisfiable Sets (MUSes).
  • Prioritise rules based on relevance, recency, and source.

Risk Assessment (Months 11-12)

  • Develop a compliance risk scoring system.
  • Leverage AI and data from company filings for risk prediction.
  • Produce a final compliance risk report.

Theoretical Framework in Economics

Artificial Intelligence (AI) as Adaptive Capital

A novel form of productive capital with unique properties that drive economic impact:

Key Economic Properties:

  1. Dynamic Efficiency: Self-improvement through machine learning drives productivity.
  2. Repurposability: Flexible application to diverse compliance tasks.
  3. Scalability: Low marginal costs enable rapid scaling.
  4. Labour Impact: Augments high-skill roles and automates repetitive processes.
  5. Value Alignment: Aligns AI objectives with societal and economic goals.

Implications for Regulatory Compliance:

  • Reduced regulatory reporting times through dynamic efficiency.
  • Scalable solutions for cost-effective compliance across firm sizes.
  • Enhanced information access, reducing asymmetry in decision-making.

Economic Impacts of AI in Compliance

Economics of AI
  1. Efficiency Gains: Self-improving models reduce regulatory processing times.
  2. Cost Savings: Scalability lowers compliance costs for SMEs.
  3. Labour Market Impact: Augments high-skill roles, automates routine tasks.
  4. Risk Mitigation: Flexible adaptation to regulatory updates reduces compliance risks.
  5. Information Accessibility: Bridges knowledge gaps, enhancing decision quality.

Why This Matters:

  • AI transforms regulatory compliance into a scalable, efficient process.
  • Balances cost-effectiveness with ethical considerations like transparency and fairness.

Finance and AI Research lab (FAIR)

Methodology Overview

Hybrid Economic Analysis Framework

  1. Process Mapping: Establish baseline workflows and resource allocation.
  2. Cost-Benefit Analysis: Quantify direct and indirect cost savings.
  3. Simulation Modelling: Test adaptability of RAG models to evolving regulations.
  4. Stakeholder Feedback: Gather practical insights on usability and challenges.

Hybrid Economic Analysis Framework

Ethical Considerations

  • Fairness: Minimise bias via curated datasets.
  • Accountability: Establish clear documentation for decision trails.
  • Human Oversight: Support compliance professionals without replacing roles.

Finance and AI Research lab (FAIR)

Future Work

  1. Train domain-specific language models for finance.
  2. Enhance retrieval accuracy using semantic search.
  3. Explore long-term cost and efficiency gains via real-world trials.

Thank You!

Contact Information

Dr Barry Quinn

Queen’s University Belfast

📧 b.quinn@qub.ac.uk

Finance and AI Research lab (FAIR)

2nd Symposium of Finance and AI Research lab